npj Imaging

Label-free optical redox imaging utilizes endogenous NAD(P)H and FAD autofluorescence to evaluate metabolism in living specimens. The conventional optical redox ratio collapses these two channels into a single value; however, it does not indicate whether a pixel has sufficient photon support or the cellular context necessary for quantitative aggregation. To address this limitation, we introduce FPhaS, a fixed-calibration phase- autofluorescence framework that integrates quantitative phase imaging (QPI) with simultaneous label-free autofluorescence multi-harmonic microscopy (SLAM), using fluorescence lifetime imaging (FLIM) solely for validation. Because QPI and SLAM are acquired with the same objective, a unified non-biological calibration aligns phase-derived structural data with the autofluorescence frame, yielding a residual error of 0.39 pixels. This calibration is maintained across all biological specimens. This shared geometric reference enables local evaluation of structural and metabolic information, rather than comparing approximately aligned images. FPhaS decomposes the data into cell presence, ratio credibility, and confidence-supported pooling. We validated FPhaS on A549 cells under high and low-photon conditions; the framework is designed to generalize to other cell and tissue types. Confidence-weighted intensity redox estimates were compared with lifetime-derived measurements within mask-locked cellular regions. Concordance improved exclusively when both the denominator photon support and an independent structural criterion were satisfied. The same reference layer generated cell-level descriptors of metabolic content, metabolic-structural organization, and measurement reliability, while also constraining the CombinedWLS reconstruction under diminished fluorescence acquisition. FPhaS redefines label-free metabolic imaging from producing comprehensive ratio maps to identifying regions where optical evidence substantiates quantitative inference.

Coherent Raman spectroscopy enables label-free biochemical fingerprinting of live cells with subcellular resolution. We previously developed a machine learning framework capable of classifying glioma FFPE tissues using Raman spectral signatures. To accelerate live cell acquisition, we previously developed RADAR (Raman Spectral Analysis Using Deep Learning for Artifact Removal), a method that increases imaging speed by an order of magnitude while preserving spectral integrity. By integrating high-speed Raman imaging with supervised machine learning, we aimed to define unique biochemical fingerprints specific to cell type. We hypothesized that intrinsic biochemical composition alone is sufficient to distinguish cellular identity and tumor subtype. To test this, we generated metabolic maps of diverse brain-derived cell types--including astrocytoma, oligodendroglioma, and glioblastoma cells--using coherent Raman spectroscopy at single-cell resolution. Patient-derived brain tumor cell lines representing genetically heterogeneous backgrounds were analyzed. Samples were stratified by IDH1 mutation status (IDH1-mutant and IDH1-wild-type) and histologically classified as oligodendroglioma or astrocytoma. Raman spectral data were acquired from 286 live single cells across the two principal molecular classes, with further subdivision into two histologic subtypes within the IDH1-mutant group. Classification was performed using an XGBoost model with shallow tree depth (1-3), a 20% held-out test set, and grouped, stratified 5-fold cross-validation to control for sample-level bias. The machine learning framework distinguished IDH1-mutant from IDH1-wild-type cells with a ROC-AUC of 0.78 and further discriminated IDH1-mutant astrocytoma from oligodendroglioma cells with a ROC-AUC of 0.81. Feature importance analysis demonstrated that separation between IDH1-mutant and IDH1-wild-type cells was driven primarily by Raman peaks associated with protein amide bands, total NADH, unsaturated fatty acids, and heme-related vibrational modes. Within the IDH1-mutant class, discrimination between oligodendroglioma and astrocytoma was driven by lipid-rich vesicle signatures, protein/polyamide amide bands, and lipid-associated spectral features. Together, these findings support the feasibility of label-free, machine learning-assisted Raman profiling to resolve clinically relevant glioma subtypes at single-cell resolution. This scalable analytical framework provides a translational platform for investigating metabolic heterogeneity, therapeutic response, co-culture systems, and patient-derived organoid models.

Light-sheet fluorescence microscopy (LSFM) has revolutionized biological imaging by enabling high spatial and temporal resolution with minimal photodamage. However, conventional LSFM techniques often suffer from striping artifacts in the resulting images due to light scattering and absorption within samples, leading to uneven illumination that negatively impacts the accuracy of subsequent image analyses. To address this limitation, we introduce dodecagon light-sheet fluorescence microscopy (dodecaLSFM), a novel approach that maximizes angular diversity to achieve homogeneous illumination and suppress striping artifacts. dodecaLSFM employs diffraction optics and cylindrical lenses to generate twelve light sheets, providing 360 degree omnidirectional illumination that significantly enhances illumination uniformity compared to traditional mSPIM, mDSLM, and ultramicroscopy systems, which use only one or two illumination planes. We demonstrate the effectiveness of dodecaLSFM by achieving high-resolution imaging of whole mouse brain vasculature following tissue clearing, allowing precise morphometric analysis of vascular networks without striping artifacts. Furthermore, we show that combining dodecaLSFM with expansion microscopy (ExM) enables whole-organ 3D imaging at cellular resolution. This novel approach provides an advanced, scalable solution for large-volume imaging, facilitating detailed structural and functional studies across diverse biological applications.

Optical fluorescence microscopy enables visualization of biological structures and dynamics. However, the intrinsic diffraction limit, especially axially, and depth-related scattering noise compromise the image resolution and fidelity. Computational 3D deconvolution is a promising approach for mitigating these issues, yet its execution is hindered by inaccurate and cumbersome theoretical modeling or experimental measurement of 3D point spread function (PSF), as well as ineffective 3D noise regularization. Furthermore, in the 3D super-resolution regime, there remains a lack of standardized tools for evaluating 3D super-resolution fidelity. Here, we present the 3D adaptive deconvolution and evaluation (3D-ADE) toolkit, which comprises 3D-Ada deconvolution with physics-oriented automatic 3D-PSF calibration, and 3D-SQUIRREL for 3D super-resolution quality assessment. It effectively resolves noise instability, eliminates the need for 3D-PSF calibration, and reliably assesses the fidelity of 3D resolution extension via deconvolution, physical, and deep-learning-based methods. Accessible via multiple software platforms, 3D-ADE enhances the versatility of 3D deconvolution and fills the gap in 3D super-resolution evaluation tools, and thereby advances volumetric fluorescence imaging applications.

Fluorescence lifetime imaging microscopy (FLIM) provides molecular contrast that is largely independent of fluorophore concentration, yet it remains constrained by a persistent trade-off among acquisition speed, photon dose, and detector complexity. To address this challenge, we developed image-projection fluorescence lifetime imaging microscopy (IP-FLIM), an integrated optical and computational platform that enables high-resolution, component-resolved lifetime imaging using only a linear single-photon avalanche diode array. We validate IP-FLIM using fluorescent microbeads and bovine pulmonary artery endothelial cells, demonstrating up to 22.3x improvement in contrast-to-noise ratio and 72.3% reduction in background noise over conventional filtered back-projection reconstruction. By combining wide-field projection acquisition with computational k-space reconstruction, IP-FLIM provides a scalable route to fast, high-resolution multiplex lifetime imaging.

Coherent structured illumination microscopy (c-SIM) is a synthetic aperture optical technique for sub-diffraction limit imaging that extends the utility of traditional SIM to non-fluorescent samples. Here, we present a complementary 5-beam implementation of c-SIM that provides enhanced optical sectioning compared to conventional quadrupolar illumination. Since our approach detects intensity images due to coherent light scattering, it avoids the complications associated with detecting complex fields. Through comparative measurements on calibration samples and live microalgae, we show that 5-beam c-SIM effectively suppresses coherent defocus effects, improving image quality while simultaneously providing a 2-fold lateral resolution improvement.

Rapid and accurate pathogen identification is crucial for the clinical management of infectious diseases, particularly sepsis and severe respiratory infections, yet standard clinical workflows remain slow and resource-intensive. Here, we developed an automated, high-throughput imaging platform built on standard, clinically accessible bright-field microscopy, and generated a large dataset comprising 24.9 million label-free bacterial cells across six focal pathogens. Leveraging this resource, we trained a neural network (ESKAPe-ResNet) to identify ESKAPe species at the single-bacterium level. The model achieved >92% accuracy in species-level classification and >82% accuracy in quantifying ESKAPe abundance in mock mixtures, with high specificity against non-ESKAPe bacteria. In clinical validation using sputum, bronchoalveolar lavage fluid and blood samples from patients with respiratory infections and sepsis, the approach correctly identified the dominant ESKAPe pathogen in >78% of samples after minimum broth culture enrichment. The imaging-to-identification pipeline was completed in under 10 minutes, and coupled with brief cultivation, the median time to accurate identification was reduced to 5-6 hours, compared with days for conventional blood culture-based workflows. This work establishes the proof-of-principle for label-free, hardware-minimal rapid pathogen identification, providing a clinically deployable workflow to expedite diagnosis and reduce mortality in severe bacterial infections.

Three-dimensional (3D) imaging represents the development of next generation of fluorescence microscopy. However, routine axial down-sampling makes isotropic resolution unrealistic. Here, we propose DeepUI, a physical zero-shot framework designed to achieve isotropic 3D fluorescence images from a low axial sampling rate. DeepUI fully leverages the intrinsic characteristics of 3D images through physics-guided degradation, which incorporates spatial-frequency joint learning to generate a scaled optical transfer function, combined with noise degradation and an up-sampling branch. Typically requiring just 5 minutes for training and 0.5 minutes for high-throughput and fast prediction, we demonstrate the superior performance of DeepUI to get isotropic results, and the exclusivity to axial down-sampling conditions, even in more challenging conditions, including defocused background, noise, and resolution blur.

Label-free scattering imaging is widely used in pathology because it enables sensitive tissue assessment without exogenous contrast agents. Yet its limited optical penetration has prevented scattering-based methods from being applied to whole-organ pathology mapping. Here we present clearing-assisted scattering tomography (CAST), a high-throughput, label-free whole-brain mesoscope enabled by selective lipid clearance for scattering enhancement (SELiC). SELiC modulates endogenous refractive-index heterogeneity in cleared tissue, providing whole-brain optical penetration while retaining strong scattering contrast from amyloid plaques and white-matter fibre bundles. CAST enables volumetric imaging of intact mouse brains and brain-wide mapping of amyloid plaque pathology across anatomical regions. This platform establishes a scalable route for label-free, system-level analysis of amyloid pathology and tissue architecture in Alzheimers disease (AD) models.

Quantitative analysis of three-dimensional cellular architecture is fundamental to understanding tissue organization, disease progression, and drug response. Yet 3D cell segmentation remains a critical bottleneck due to diverse cell morphologies, low signal-to-noise ratios, and data scarcity. We introduce Penumbria, a general-purpose 3D cell segmentation framework that achieves state-of-the-art accuracy across morphologically distinct cell populations and imaging conditions in volumetric microscopy. Penumbria formulates segmentation as a regression problem on distances to cell boundaries, supporting instance reconstruction without shape priors and permitting end-to-end GPU inference. A U-Net-based architecture with xLSTM bottleneck blocks and patch embeddings enables multi-scale feature extraction, long-range modeling of spatial context, and convolutional feature-volume tokenization. The model is extended with two modules: a Global Zernike Phase Layer, which learns Zernike-parameterized phase corrections in the frequency domain to undo optical aberrations such as defocus and tilt, and a Scaled Geocaps Layer, which samples features at fixed grid locations across multiple spatial scales, routing evidence between them such that a detection is only confident where concordance holds across scales simultaneously. Across four diverse 3D datasets selected to probe the limits of existing methods, Penumbria outperforms Cellpose-SAM across all evaluation thresholds and surpasses StarDist-3D on most datasets while matching it on Parhyale hawaiensis. Trained entirely from scratch, Penumbria achieves up to a 38% improvement in mean average precision over the second-best method. Strong boundary accuracy further supports downstream analyses such as quantifying membrane dynamics or protein localization.

Diagnostic assessment of breast cancer biopsies remains reliant on resource-intensive histopathology and molecular profiling, which often lack real-time physiological readouts. Magnetic levitation (MagLev) enables label-free density profiling of single cells, yet its application to intact tissue biopsies has been precluded by size-dependent geometric artifacts and the absence of analytical frameworks for biopsy-scale samples. Here, we report the first application of MagLev to intact invasive breast carcinoma biopsies (200-600 m) for biophysical profiling, generating multivariate biophysical signatures from 203 samples across 17 patients. We developed a physics-based size-correction algorithm (xmc) that isolates biological density from geometric artifact, and demonstrate that tissue viability is predicted not by average levitation height, but by spatial heterogeneity across replicate samples, reflecting the microenvironmental complexity of metabolically active tumors. Multivariate integration using Partial Least Squares (PLS) regression and Factor Analysis of Mixed Data (FAMD) identified nodal status (N) as the strongest biophysical predictor, suggesting that lymphatic dissemination capacity leaves a measurable signature in the primary tumor density profile. Unsupervised patient clustering in PLS-derived latent space recovered three clinically coherent subgroups aligned with molecular subtypes. This 30-minute, low-cost assay provides exploratory biophysical stratification complementary to existing diagnostics, particularly in resource-limited settings.

Hyperspectral imaging (HSI) has gained increasing attention for bone assessment because it captures rich wavelength dependent information associated with mineralised tissue. HSI provides detailed spectral information related to material composition, while 3D geometric information supports the analysis of surface morphology and structural detail. However, integrating spectral and geometric information remains challenging, particularly when conventional reconstruction pipelines depend on external pose estimation. To address this challenge, we propose BoNeRF-HS, a self-calibrated hyperspectral neural radiance field for 3D reconstruction. BoNeRF-HS jointly optimises camera intrinsics, volume density, and hyperspectral radiance, removing the need for COLMAP based poses. To improve spectral modelling, we incorporate a gated spectral adapter head that learns wavelength dependent radiance features for hyperspectral view synthesis. We evaluate BoNeRF-HS on a multi-view hyperspectral dataset containing mouse bone, trabecular bone analogue, and cortical bone analogue samples. Experimental results demonstrate that our framework achieves improved reconstruction quality, and better preservation of bone surface details compared with existing approaches.

AbstractThe infiltrative, non-enhancing margin of IDH wildtype high grade glioma (IDHwt HGG) harbors distinct molecular programs that drive invasion and therapeutic resistance, yet remains largely unevaluable by conventional tissue sampling approaches and by conventional imaging. Here we show that this invasive architecture is encoded within multiparametric MRI (mpMRI) feature relationships and can be decoded using a graph-based framework trained on multiregional image-localized biopsies. Across 134 spatially matched biopsy-imaging pairs from 35 patients with primary IDHwt HGG (29 glioblastomas (GBM) and 6 non-glioblastoma HGGs), unsupervised graph community detection identifies two imaging-defined clusters that localize to invasive tumor regions without molecular supervision. Transcriptomic profiling associates these clusters with neuronal (NEU) and glycolytic-plurimetabolic (GPM) molecular programs. Building on this framework, a graph convolutional network (GCN) accurately predicts NEU and GPM transcriptional states in independent training and validation cohorts and significantly outperforms conventional convolutional neural networks. Applied to whole-tumor mpMRI volumes, the trained GCN generates spatially resolved probability maps that quantify the distribution and relative burden of NEU and GPM programs across both MRI contrast-enhancing and non-enhancing invasive regions. These imaging-derived molecular maps stratify patients by overall survival. Increased GPM burden is associated with poorer survival, consistent with the aggressive behavior associated with mesenchymal-like transcriptional programs in IDHwt HGG. In contrast, increased NEU burden is associated with improved survival, identifying a previously unrecognized imaging-derived prognostic biomarker that was not detected by biopsy-based molecular classification alone. Together, these findings establish a graph-based imaging framework for spatially resolved molecular classification of invasive IDHwt HGG and demonstrate that whole-tumor molecular state architecture carries prognostic information beyond conventional tissue sampling.

Integrating tissue-level organisation with sub-cellular resolution and molecular information often requires combining multiple microscopy modalities and scales. However, aligning images acquired with different modalities, settings, or instruments remains challenging. Here, we introduce NucleiSky, a microscopy image registration framework that utilises the spatial arrangement of nuclei or other landmarks as an intrinsic biological fingerprint. NucleiSky represents images as constellations of centroids and aligns them using geometric algorithms and spatial consensus scoring. In benchmark datasets, NucleiSky could localise query regions within larger reference images using as few as five nuclei. We show that NucleiSky can locate high-magnification fields of view within low-magnification overview scans, map these alignments to additional channels, support live brightfield-to-fixed registration using synthetic nuclear labels, and guide microscope retargeting. We further show that the same constellation-matching principle can be extended to 3D localisation and to non-nuclear landmarks. These findings establish local landmark geometry as an intrinsic spatial fingerprint that enables localisation and registration across imaging scales, modalities and microscopy platforms. NucleiSky is available as an open-source Python package and as notebook-based applications.

Cryo-electron tomography is an expanding technology for the study of macromolecules, viruses, and cells. It is often applied to specimens that are too large or heterogeneous for methods based on 2D image averaging such as single particle analysis, e.g., intracellular membranes or organelles. Current practice records a tilt series of projection images in rotation. Reconstruction is normally an ill-posed mathematical problem. Particularly for the under-determined case of sparse data, discrete tilt angles, and a limited tilt range, characteristic artifacts appear in the reconstructed slices. Much of what appears as noise is in fact structural: the projection of contrast from different planes. Various schemes are employed to regularize the reconstruction, including machine-learning frameworks built on neural networks. To the extent that the noise is structural, it might be suppressed by deconvolution with a suitable kernel. This was demonstrated and has been used regularly in cryo-STEM tomography of thick specimens where the under-sampling problem is particularly acute. Here we present 3dcon as an open-source extension of the entropy-regularized deconvolution algorithm that had been adopted from fluorescence microscopy. It takes advantage of modern computing hardware for convenient and fast processing. Deconvolution is entirely algorithmic, meaning that successful processing of the data does not depend on the data itself. As such it should be robust in a wide variety of applications.

While Single Molecule Localization Microscopy (SMLM) aims to generate precise coordinates of molecular targets in cells, the resulting point clouds are inherently blurred by additive noise sources across the experimental, imaging, and processing workflow. This blurring often limits SMLMs ability to accurately quantify complex assembled structures required to address biological issues, despite reported localization precision down to a couple of nanometers. Here, we present SMLMFlow, a machine learning framework for improving structural resolution in SMLM datasets that combines a graph neural network and a hierarchical transformer with flow matching. We show that SMLMFlow improves structural resolution and downstream quantification across different structures, including filaments and protein nano-clusters, and generalizes to new unseen photophysics models.

Label-free tracking of adherent cell migration could enable important insights into biological processes such as tissue repair, inflammatory response, or cancer progression. Nevertheless, visualizing unlabeled animal cells using optical microscopy remains challenging due to low contrast as well as frequent changes in cell shape and number. A promising alternative uses electrical capacitance measurements, which are sensitive to cell adhesion to electrode surfaces. However, prior examples often utilized electrodes with areas larger than single cells, resulting in averaged readouts over multiple cells. Here, we demonstrate label-free, live-cell tracking using a capacitance sensor array with more than 1 million pixels on a 10 micron pitch across an area larger than 1 square centimeter. We show that single cell morphology can be clearly segmented, and then used to reconstruct migration and proliferation dynamics using optical flow. We further track the spreading of multicellular spheroids, revealing fast-moving peripheral regions led by a collective leader cell "front." Finally, we demonstrate label-free imaging of millimeter-scale honeycomb-shaped tissues without the multi-image stitching often required for conventional microscopy. We utilize mutual capacitance measurements with electrically-programmable electrode spacing to reconstruct topographical features of these engineered tissues. Overall, CMOS capacitance imaging arrays enables label-free imaging spanning from single cells to large tissues, in a portable and scalable format for settings where optical microscopy may be difficult to access.

Due to its ability to establish a pool of undetectable and latently infected cells that can initiate viral production through random reactivation, a cure to human immunodeficiency virus (HIV) infections has remained elusive. Many approaches have been proposed, including the "shock and kill" method where latency reversing agents (LRAs) are administered to reactivate latently infected cells out of latency and remove them through immune targeting and clearance, and the "block and lock" method where latency promoting agents (LPAs) are administered to inhibit reactivation and potentially induce a "deep latency" state where infected cells can no longer reactivate. Previous large scale drug screen studies have demonstrated a correlation between a compound's capability to modulate the fluctuations (or "noise") in HIV gene expression and its potential to modulate HIV latency. However, measurements of gene expression noise are labor- and cost-intensive. To circumvent these drawbacks, we trained a variational autoencoder (VAE) on a previously published large scale time-lapse fluorescence microscopy dataset, and performed an in silico screening of ~175,000 compounds for HIV latency modulators. Out of the top 113 predicted modulators that were experimentally tested, 16 latency reversing agent (LRA) synergizers and 2 latency promoting agents (LPAs) were confirmed, yielding an overall experimental hit rate of 15.9%. Our work demonstrates that in silico drug screening modalities, guided by existing large-scale experimental datasets, can yield high experimental hit rates, reducing costs incurred from labor-intensive wet lab-focused methodologies.

In vivo infrared thermography is limited by the inherently poor spatial resolution at long wavelengths, low contrast, and the lack of biocompatible contrast agents. Here, we present 3-5 m mid-wave infrared (MWIR) thermography enhanced by an artificial intelligence (AI) network and cold phosphate-buffered saline (PBS) as a thermal contrast agent for noninvasive in vivo imaging with high contrast and resolution. MWIR imaging enabled high thermal sensitivity with microscale spatial resolution, strong relative thermal contrast, and facilitated visualization of the subcutaneous vasculature in the human arm, hand, ankle, the femoral artery and vein in rats, and the femoral vessels in mice, with image contrast further enhanced by AI networks. In a 4T1 tumor-bearing mouse model, AI-enhanced MWIR resolved early-stage tumors of ~2.3 mm and metastases as small as ~1.7 mm. Using cold PBS as a MWIR thermal contrast agent, we achieved precise tumor boundary visualization and real-time imaging-guided tumor resection. AI-enhanced MWIR offers a promising solution for early diagnosis and improved surgical precision.

With the rapid expansion of global food demand, aquaculture has become a critical pillar for future food security. However, aquaculture systems remain highly vulnerable to pathogenic bacteria, and rapid identification of antagonistic microbes is essential for sustainable disease control. Conventional evaluation approaches rely on fluorescence labeling or post-culture assays, limiting the ability to quantify dynamic interactions in mixed microbial populations in a real-time and label-free manner. Here, we propose a computational framework for classifying the mixing ratio of Vibrio harveyi and environmental bacteria using time-series motion features extracted from microscopy videos. We defined 24 interpretable motility descriptors and employed a Temporal Convolutional Network (TCN) to learn their temporal structure. The proposed method achieved a classification accuracy of 93.3%, outperforming conventional static statistical approaches and alternative machine learning models. These findings indicate that mixture discrimination in microbial communities is governed not by absolute motility magnitude, but by collective alignment and its temporal stability. Our study establishes a time-resolved computational framework for quantifying dynamic collective order in mixed microbial populations and highlights its potential for label-free automated screening and robotic microbiological applications.